Enriched Video Semantic Metadata: Authorization, Integration, and Presentation

An enriched video metadata framework including video authorization using VAST, metadata integration, and user level applications is presented. The Video Annotation and Summarization Tool (VAST) is a novel video metadata authorization system that integrates both semantic and visual metadata. Balance between accuracy and efficiency is achieved by adopting a semi-automatic authorization approach. Semantic information such as video annotation is integrated with the visual information under a XML schema. Results from user studies and field experiments using the VAST metadata demonstrated that the enriched metadata were seamlessly incorporated into application level programs such as the Interactive Shared Educational Environment (ISEE). Given the VAST metadata, a new video surrogate called the smartlink video surrogate was proposed and deployed in the ISEE. VAST has become a key component of the emerging Open Video Digital Library toolkit.